Chaos and universality in two-dimensional Ising spin glasses 
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Recently extended precise numerical methods and droplet scaling arguments allow for a coherent 
picture of the glassy states of two-dimensional Ising spin glasses to be assembled. The length scale 
at which entropy becomes important and produces "chaos" , the extreme sensitivity of the state to 
temperature, is found to depend on the type of randomness. For the ±J model this length scale 
dominates the low-temperature specific heat. Although there is a type of universality, some critical 
exponents do depend on the distribution of disorder. 
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Glassy systems, characterized by extremely slow re- 
laxation and resultant complex hysteresis and memory 
effects, are difficult to study because their dynamics en- 
compass a great range of time scales [ij . Glassy materi- 
als include those without intrinsic disorder, such as sil- 
ica glass, and those where quenched disorder influences 
the active degrees of freedom. An example of a model 
of the latter is the Edwards- Anderson spin glass model 
[2], which includes the disorder and frustration neces- 
sary to capture many of the complex behaviors seen in 
disordered magnetic materials. Though this prototypi- 
cal model of glassy behavior was originally proposed well 
over 30 years ago, many aspects of it remain poorly un- 
derstood. The droplet and replica-symmetry-breaking 
pictures of spin glasses provide distinct views of spin glass 
behavior [3] . Analytical results are rare, so numerical ap- 
proaches are invaluable for both testing and motivating 
new ideas. But the numerics are also exceedingly dif- 
ficult: computing spin glass ground states is in general 
a NP-hard problem [4]. It is believed that these classes 
of problems require exponential computational time to 
solve exactly [5]. 

A fortunate special case which is not prone to this com- 
putational intractability is the two-dimensional Ising spin 
glass (2DISG). The Hamiltonian is "H = JijSiSj, 
where the couplings J7 = {Jij} are independent random 
variables coupling classical spins s = ±1 at sites iJ on 
a square toroidal grid with sites. The randomness of 
the sign of Jij leads to competing interactions, not all 
of which can be satisfied. In general, such models have 
complex (free) energy landscapes and very slow dynam- 
ics. The most commonly-used distributions for the Jij 
are the ± J distribution where each bond value is ±1 with 
equal probability, or the Gaussian distribution where the 
Jij are chosen from a univariate Gaussian distribution 
with zero mean. One apparent difficulty in using the 
2DISG as a model system is that truly long-range spin- 
glass order only occurs at zero temperature. However, at 
low enough temperature such that the correlation length 
^ exceeds L one can study a regime of glassy behavior. 



In this glassy regime, the dominant spin configurations 
are very sensitive at large length scales to small changes 
in temperature or other global perturbations; this sensi- 
tivity is referred to as "chaos" . 

Highly developed numerical algorithms [U |6H9] can ef- 
ficiently circumvent the complexity due to disorder and 
frustration: ground states and finite-temperature parti- 
tion functions of the 2DISG may be computed in time 
polynomial in L. Still, this model is difficult to study 
numerically due to strong finite-size effects. Prior to the 
present work, the combination of scaling ideas and exact 
and Monte Carlo numerical evidence had been unable 
to develop a full understanding of the low-temperature 
glassy regimes [TO] . 

In this Letter, we deduce results for the thermody- 
namics and droplet scaling in the glassy regime and the 
accompanying chaos by carrying out precise calculations 
at low temperatures and analyzing a variety of quanti- 
ties, including the sensitivity of the entropy and energy 
to boundary conditions. These results give a much more 
consistent and detailed picture of this important model 
system and also have applications to other models for 
disorder in all dimensions. We extend fast algorithms 
[71 [S] to study general disorder distributions. By em- 
ploying arbitrary precision arithmetic, we have derived 
reliable numerical results to very low temperatures and 
large L (beyond those attained with Monte Carlo simula- 
tions). The ground states for ±J vs. Gaussian couplings 
are known to have very different properties [111 I12j , but 
it has been shown [T3] that there is in a certain sense uni- 
versal behavior, independent of disorder distribution, at 
finite temperatures. The critical behavior is universal at 
large length scales where the effective couplings are con- 
tinuously distributed [13], but we argue that this scaling 
and universal chaos applies only above a temperature- 
dependent crossover length scale £x (T) that itself scales 
differently for ± J vs. continuously-distributed bare cou- 
plings. We thereby deduce related but different critical 
exponents for Gaussian and ±J disorder; Ref . fT3l had in- 
stead suggested the exponents are the same. We use 
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numerical results to support these conclusions for the 
2DISG. These insights into chaos and thermodynamics 
will help the exploration of glassy dynamics [M] and ex- 
tend the utility of this model as a standard for studying 
spin glasses in general. 

Ordering in the glassy regime is subtle, as spin corre- 
lations have sample- and location-dependent signs. How- 
ever, the magnitude of (siSj)^ decays slowly for < 
This ordering is evident in the effect of boundary condi- 
tions on thermodynamic quantities. We start by com- 
puting the partition function Zp(J^) in a sample with 
periodic boundary conditions. Without additional com- 
putational effort, we then also have Z^p for antiperiodic 
boundary conditions, where the horizontal bonds along a 
vertical column have Jij negated, as both are signed sums 
of four Pfaffians [5]. The sample-dependent difference in 
free energy F is 5F{J) = -kT\n[Zp{J)/ZApiJ)]. We 
use finite differences over T to compute the heat capacity 
C, the average energy E, and the entropy S. The sample 
variances Var(5X) of SX = Xp - Xap for X ^ F, E, 
S, or C help characterize the SX distributions. In the 
glassy regime L < these differences arise from scale-L 
relative domain walls that cross the sample: the magni- 
tudes of SX for these walls are taken to scale as would 
general droplet excitations at scale L in an infinite-size 
system [TS]. We study from about 500 to 10"* samples 
at each temperature. The computation of Z for a 512^ 
sample at T = 0.1 requires 1.6 GB of memory and 4.4 h 
on a 2.6 GHz Opteron core. Error bars in all plots in this 
paper represent zblcr statistical errors. 

Temperature chaos One of the most notable fea- 
tures of such a disordered magnet is "chaos": a great 
sensitivity of the dominant spin configurations to small 
perturbations of the temperature [151 I16j . This sensi- 
tivity results from the delicate balance between entropy 
and energy in the glassy state: small temperature shifts 
can flip the sign of the free energy of large-scale droplets. 
We define a crossover length (T) to be the scale where 
the entropy of a droplet or domain wall becomes impor- 
tant: For scales i with ^(T) > £ > ix{T), the entropy 
change \SS\ is typically larger than \SF\/T. A temper- 
ature change of size ST < T can then reverse the sign 
of the free energy 6F = SE — TSS of the droplet or do- 
main wall, so this is the chaotic glassy regime. Here 
SS is continuously distributed, so even if the distribu- 
tion of SE is discrete, as in the ± J model, the effective 
couplings SF{£) are continuously distributed for scales 
£ > £x- The natural assumption we make and verify is 
that when £ > £x the exponents for the scaling with £ 
are independent of the bare disorder distribution. In a 
region of size £, for £,{T) > £ > £x{T) the lowest free 
energy droplet of size of order £ has a typical free energy 
SF{£) ~ {£/£xySF{£x), where 6* < is the usual stiffness 
exponent. The boundary of this droplet is a fractal do- 
main wall with dimension df, and the typical SS scales 
as SS{£) - {£/£x)'^f/^SS{£x). In verifying this picture. 
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FIG. 1: [color online] Chaos is evident in plots of SF = 
Fp — Fap, the change in free energy with boundary condi- 
tions, vs. temperature T for both Gaussian and ±J disorder. 
Each panel shows curves for 50 samples of size . Randomly 
chosen curves are highlighted to improve visibility. The num- 
ber of zero crossings of SF increases with L, even over the 
diminishing temperature range where SF is appreciable. 

we will use accepted values 6 = —0.28 and df = 1.274 
pn [T^ [T5] computed in ground state simulations with 
Gaussian couplings, rather than fitting our data to rede- 
termine these values. 

Chaos can be seen in zero crossings of SF{T), which 
imply a reordering of the values of F for P and AP bound- 
aries at scale L. A subset of the data for SF{T) is dis- 
played in Fig.[l] each curve indicates SF{T) for a single 
sample (also see [TT]). Note that in the region of ap- 
preciable SF, the number of crossings increases as L in- 
creases. This helps justify the study of the 2DISG as a 
chaotic glassy model since a large sample will go through 
a large number of very different states as the temperature 
is lowered. 

Non-universal scaling and the crossover length 

We argue that the dependence of the crossover length 
£x on temperature T is non-universal, so that some of 
the critical exponents for different disorders are distinct, 
though related. At short length scales, £ < £x{T), 
TSS < SF, so that the thermodynamics at these scales is 
determined primarily by energetics and the T — fixed 
point sets the scaling behavior. In a system of size L 
where £x{T) > L, chaos is frozen out (there are typically 
no zero crossings in SF). This small-^ or low-T non- 
chaotic regime is what is seen in T = simulations. It is 
characterized by marked differences in behavior between 
the ±J and Gaussian disorder distributions [TTl 112] . 

For Gaussian disorder, the entropy of a droplet at scale 
^ < ^ is concentrated on the fractal domain wall with a 
typical total length £'^f . The entropy difference is due 
to the difference in the local excitations that are affected 
by the introduction of this domain wall. Presuming that 
the local excitations at length scale ~ 1 have a gapless 
spectrum with a constant width, the fraction of the do- 
main wall that is thermally active and contributes to the 
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entropy difference is proportional to T. Tlie entropy of 
the droplet, 5S is then a sum of ~ T^''^ terms of ran- 
dom sign so that Var(5S') w Ti'^f a{Te~'>) with the scal- 
ing function a{x) — ^ const, as a; 0. The non-chaotic 
regime breaks down when TSS - T^/^et^/^ ^ f-i ^ SF, 
giving ire ~ y-3/(dj-2e) Gaussian disorder. 

For ±J disorder and low T, the entropy of a scale- 
e droplet with £ < 4(T) is found to scale as SS ^ (^'^ . 
The value of 9s is fixed by the T = domain wall entropy 
due to zero-energy spin rearrangements, and estimated 
numerically to be 9s = 0.5 J20]. Additionally, the typical 
(free) energy of excitations at zero temperature has been 
found to be 0(1), independent of L [TTl [H], which we 
have verified: fitting 6F{T = 0) to a simple power law 
over L = 32 — >■ 256 gives an exponent with magnitude 
less than 0.015. The crossover scale £x therefore occurs 
when 5E 6F TSS - 0(1), giving 4 ~ T'^/f^s ^ 
that Gaussian and ± J distributions have distinct scaling. 
Crucially, this also means 5F{£x) ^ in contrast 

with 6F{ix) ~ for the Gaussian case; this introduces 
an additional source of nonuniversality. 

For Gaussian disorder, the free energy magnitude 
scales as Var((SF) f'^ (j)(T(.~^) with scaling function 
(j){x) — >■ const, as a: — T' [Tni[TB]. The correlation length 
^(T) is set by the scaling argument x — 0(1), which 
gives ^ ~ y-'^G -^ith vq = —1/9 ^ 3.5. For ±J disorder, 
low T and £ > £x{T) in the universal, chaotic regime, 
Var((5F) « (^/4)^V[T(^/4)~''] with the same univer- 
sal scaling function (j){x). But here the argument of the 
scaling function has different T-dependence from what it 
has with continuously-distributed disorder. As a result 
the correlation length scales with a different exponent, 

i - T-"^*, with v± = i/es - i/e^ 5.5. 

We computed Var((5F) for samples chosen indepen- 
dently at each temperature. We directly test the scal- 
ing forms expected for 5F by a finite-size scaling collapse 
of this data with no free parameters. For the Gaussian 
data, shown in Fig. [2]ja), we find agreement with the ex- 
pected exponents and thus a good estimate of the scal- 
ing function (f){x). We plot the data for the ±J model 
using its expected scaling in Fig. [2jb), where the same 
scaling function 4>{x) with only constant rescaling should 
appear. Although the expected deviations are apparent 
at low temperature and small L where L < £x{T) and 
at T = 0(1), we see a trend towards good collapse of 
the data for larger L, consistent with the proposed new 
scaling, and similar curves for the 4'{x). It appears that 
for ±J disorder the universal regime of L > £x{T) and 
T < 0(1) does not emerge until L > 100. 

The chaos exponent The rate of change of 6F with T 
in an individual sample is given by the entropy difference, 
SS = —j^- Thus, in the chaotic regime, the tempera- 
ture change needed to change the sign ol SF is typically 
AT ~ SF/SS. Using the above expressions for SF and 
SS, the rate of sign changes in SF as T is varied for Gaus- 
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FIG. 2: [color online] (a) Scaling collapse for the variance 
of the twist free energy, Var(5F), for Gaussian disorder, with 
Var(5J^)L-^^ plotted vs. TL'\ (b) Scaling collapse for ±J 
disorder that accounts for the crossover-length £x{T) so that 
convergence to the same universal scaling function is expected 
(up to overall scales for T and L). There are no fitted expo- 
nents in these plots: accepted values 9 — —0.28 and 6$ = 0.50 
are used. 



sian disorder is given by \SS\/\SF\ - L^'oKGiTL^/"^) 
with chaos exponent Cg = i'^f + 1/^g)/2 and scaling 
function k{x) oc x^^^ at small argument. For ±J disor- 
der, TSS{£x) ^ 0(1), so that in the chaotic regime SS ^ 
(£/4)''//2/T and the rate of sign changes is \SS\/\SF\ - 
(L/4)'^^/^"^r-iK±(TLi/''±), with K± constant for small 
arguments. This gives C± = idf/2- 29)[9s/{0s - 9)]. 
Though these two expressions for C,' are quite different, 
they are predicted to have similar values: Cg — 0.78(1) 
and C'± = 0.77(2) (Fig.lsl). 
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FIG. 3: [color online] A plot of the scaled crossing rate 
L-^'Af{Ti,T2)/{T2 - Ti), where the average number of zero 
crossings for 5F in the interval Ti < T < r2 is Af{Ti,T2) 
[IS], using (Ti,T2) = (0.75 L"^''", 1.5 L"^/"). The rate is 
expected to scale with L as oc L^' , with Cg = 0.78(1) and 
Cj- = 0.77(2). The expected nearly constant scaled rate is 
seen for both Gaussian and bimodal disorder. 

Specific heat The behavior of the specific heat C for 
T — > in a 2DISG is dominated by the smallest thermally 
active droplets that have nonzero energy [15] . If the dis- 
order distribution is continuous, these are the smallest 
droplets of size 0(1) and energy of order T. They have 
a density proportional to T and contribute a linear term 
in the low T specific heat: C ^ T. 
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For ±J disorder, on the other hand, the droplets 
with the lowest nonzero energy have 5E = 0(1). Such 
droplets with size £ < £x{T) have SF > T at low T and 
are not thermally active. Thus at low temperature T the 
smallest active droplets with nonzero energy are of size 
£x{T). These active droplets each contribute ^ to 
the specific heat and have density T/£-^{T) so the spe- 
cific heat scales as C ~ y2/es-i^ j,^ average over 
finite-sized samples this power-law specific heat is cut off 
at the lowest temperatures when the size £x (T) of these 
active droplets exceeds L. This produces the low-T finite- 
size scaling form C ~ T^/^^~^c{TL^^), where c{x) is a 
scaling function that goes to a constant for large argu- 
ment (for temperatures where £x{T) <^ L <^ ^{T))- Our 
± J specific heat data are shown in this scaling form in 
Fig. [4j The intermediate temperature regime that cor- 
responds to the power-law specific heat only appears for 
L > 100. In fact, our data for intermediate tempera- 
tures, T « 0.35, are entirely consistent with previously 
published work [10] . which saw an effective exponent 
a w —4.2, with C ~ T~", but the effective exponent 
crosses over to lower values as T decreases. 
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FIG. 4: [color online] A scaling plot for the heat capacity 
C for the ±J spin glass. The scaled heat capacity per spin, 
(^yi-2/9s is plotted as a function of the scaled temperature 
TL^^ for samples of size L with the value of Bs = 0.50 con- 
sistent with the zero temperature scaling of the entropy of 
domain walls, 5S ~ L^^ This collapse is consistent with 

the "bulk" heat capacity being due to excitations of minimal 
size 4 ~ 



In addition to the leading terms that we discuss above 
and detect in our numerical results, there are weaker sin- 
gular contributions to C that result from the diverging 
£,{T) as T — )■ that are also there in principle, although 
they will be extremely difficult to detect. Standard hy- 
perscaling at T = predicts a contribution that scales 
as C ~ T"" - T^'' [T3], but the chaos changes this, 
making this contribution larger at low T. The contribu- 
tion to the specific heat from droplets of scale £ < ^(T) 
is the product of their density ~ 1/^^, the fraction that 
are thermally active ~ T/6F{£) and the average con- 
tribution of such an active droplet to the heat capac- 
ity ^ {5Eact{£) /TY . For standard hyperscaling, the last 



two factors are of order one for t = £,{T), but the chaos 
instead makes the last term larger. The subdominant 
contribution to C for Gaussian disorder from scale ^ is 
Qing ~ T^-oH-C'-e)^ since SE,,t/T ~ J^^ct ~ 
However, the first factor always wins, keeping the small- 
est thermally active droplets with 6E > dominant in 
the specific heat. 

Discussion Precise numerical calculations have al- 
lowed us to test new scaling relations for the thermo- 
dynamics of the 2DISG in detail and to clearly demon- 
strate non-universality and study its origin. The large 
values of ly (and long crossover lengths for ± J disorder) 
necessitate using large systems to see the scaling behav- 
ior. Even though we assumed that scaling in the chaotic 
regime is weakly universal with the same values of 9 and 
df at any given T, our results show that the critical ex- 
ponents are nevertheless different for Gaussian and ±J 
disorder, due to temperature- and disorder- dependent 
crossover length scales. We predict a violation of hyper- 
scaling due to chaos, which is a general phenomenon that 
is present in higher dimensions as well. These results will 
lead to further work on the thermodynamics and glassy 
dynamics of this glassy model at low temperature. 
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